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IN THE CLAIMS 

Please amend claims 1, 1 1, 16, 93 and 95-98 as follows: 

1 . (Cun-ently Amended) A system for maintaining a background model of an 
image sequence having a plurality of pixels, comprising: 

a pixel processing module that processes the image sequence on a pixel 

scale; 

a prediction module that provides history-based predictions for a value of 
each of the plurality of pixels; and 

at least one refinement module that processes the image sequence on a 
spatial scale other than the pixel scale. 

2. (Original) The system of claim 1 , wherein the pixel processing module 
further comprises determining an initial background model and providing an initial pixel 
assignment to each of the plurality of pixels. 

3. (Original) The system of claim 1 , wherein a first refinement module is a 
region processing module that processes the image sequence on a regional scale. 

4. (Original) The system of claim 3, wherein the region processing module 
further comprises considering a relationship between at least some of the plurality of pixels 
to provide pixel assignment. 

5. (Original) The system of claim 3, wherein a second refinement module is a 
frame processing module that processes the image sequence on a frame scale. 

6. (Original) The system of claim 5, wherein the frame processing module 
further determines a background model that most accurately represents an actual 
background of the image sequence and performs one of: (a) retaining a current 
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background model; (b) substituting a more accurate background model in place of the 
current background model. 

7. (Original) The system of claim 5, further comprising a postprocessing 
module that provides enhancement of the image sequence. 

8. (Original) The system of claim 7, wherein the enhancement is speckle 
removal. 

9. (Original) The system of claim 7, wherein the postprocessing module 
provides enhancement after the pixel processing module and before the frame 
processing module. 

1 0. (Original) The system of claim 7, wherein the postprocessing module 
provide enhancement after the frame processing module and before the region processing 
module. 

1 1 . (Currently Amended) A computer-readable medium having computer- 
executable modules, comprising: 

k a pixel processing module that processes an image sequence on a pixel 

scale and further comprising: 

a prediction module that provides at least two historv-based 
predictions of what value a particular pixel will be in a next frame of the image sequence to 
be processed and provides these predictions for each pixel within the image sequence; 
and 

at least one refinement module that processes the image sequence 
on a spatial scale other than the pixel scale. 

12. (Original) The apparatus of claim 1 1 , wherein the refinement module 
processes the image sequence on scale larger than the pixel scale. 
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13. (Original) The apparatus of claim 12, wherein a first refinement module is a 
region processing module that processes the image sequence on a region scale. 

14. (Original) The apparatus of claim 13, wherein a second refinement module 
is a frame processing module that processes the image sequence on a frame scale. 

1 5. (Original) The apparatus of claim 14, further comprising a postprocessing 
module that provides enhancement of the image sequence. 

1 6. (Currently Amended) A method for maintaining a background model of an 
image sequence having a plurality of pixels, comprising: 

processing the image sequence on a pixel scale so as to determine a 
current background model and provide an initial assignment for each of the plurality of 
pixels; 

calculating historv-based predictors for a value of each of the plurality of 

pixels; and 

refining the pixel processing by processing on a spatial scale other that the 
pixel scale to further refine at least one of: (a) the current background model; (b) the initial 
pixel assignments. 

17. (Original) The method of claim 1 6, wherein refining further comprises 
providing a region processing module that processes the image sequence on a region 
scale. 

1 8. (Original) The method of claim 1 7, wherein refining further comprises 
providing a frame processing module that processes the image sequence on a frame 

scale. 

, 1 9. (Original) The method of claim 1 8, wherein refining further comprises 
providing a postprocessing module that enhances the image sequence. 
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20, (Original) The method of daim 19, wherein the postprocessing module 
enhances the image sequence by providing speckle removal. 

Claims 21-92 : (Canceled) 

93. (Currently Amended) A system for background maintenance of an image 
sequence having a plurality of pixels, comprising: 

a pixel processing module that processes the image sequence on a pixel 

scale; 

a prediction module that provides at least two history-based predictions of a 
pixel value for each of the plurality of pixels; and 

at least one refinement module that processes the image sequence on a 
spatial scale different from the pixel scale. 

94. (Previously Presented) A method for processing an image sequence having 
a plurality of pixels, comprising: 

processing the image sequence on a pixel scale to determine a current 
background model and provide initial assignments to each of the plurality of pixels; 

calculating a plurality of predictors to provide predictions of a value of each 
of the plurality of pixels, the predictions based on an actual history of pixel values for the 
predicted pixel and a predicted history of pixel values for the predicted pixel; and 

refining the pixel processing by processing on a spatial scale other that the 
pixel scale to maintain a background model of the image sequence. 

95. ( Currently Amended) A method for processing a current image frame of an 
image sequence to classify a pixel in the current image frame as a foreground pixel or a 
background pixel, comprising: 

storing a list of actual history pixel values representing a history of actual 
pixel values for the pixel as determined in previous Image frames; 
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predicting what value the pixel will have in a next frame of the image 



sequence using the list of actual history pixel values to generate a first pixel value 
prediction; 

storing a list of predicted history pixel values representing a history of 
predicted pixel values for the pixel as determined in previous image frames; 

predicting what value the pixel wiil have in a next frame in the image 
sequence using the list of predicted history pixel values to generate a second pixel value 
prediction; 

determining an actual value of the pixel in the next frame of the image 
sequence; and 

classifying the pixel as a foreground pixel if the actual value of the pixel in 
the next frame of the image sequence differs from any one of the first and second pixel 
value predictions by more than a threshold value. 

96. (Currently Amended) The method of claim 95, wherein predicting what 
value the pixel will have in a next frame of the image sequence using the list of actual 
history pixel values to generate a first pixel value prediction further comprises using the 
formula: 



wherein stp is the first pixel value prediction at time f, are the list of actual history pixel 
values, and the a k are linear prediction coefficient s, p i c q number of prediction 
coeffic i ents, and n i s a numbor of actua l history p i x e l valu e s containod in the list of actual 
h i story pix el va l u es. 

97. (Currently Amended) The method of claim 96, wherein predicting what 
value the pixel will have in a next frame of the image sequence using the list of predicted 
history pixel values to generate a second pixel value prediction further comprises using the 
formula: 



p 
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P 

s tp = X a *v* 

wherein Stp is the second pixel value prediction at time t, are the list of predicted history 
pixel values, and the a* are linear prediction coefficient & r P is a numb e r of pr e d i ction 
coeffic ie nts, and n is a numbor of pred i ct e d h i story p i xo l va l uos conta i ned i n the l ist of 
pr e d i ct e d history pix el va l u es. 

98. (Currently Amended) The method of claim 96, further comprising computing 
the threshold value using the formula: 

4.0*^/^] 

wherein the expected squared prediction error Efa 2 ] is given by the formula: 

E[ e ?] = E[s t 2 ]+±a k E[s t s t J> 

wherein , s } is a pixel value prediction at time t o is a number of prediction coefficients, 
and n is a number of actual history pixel values contained in the list of actual history pixel 
values . 
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